Management framework for BIER in-band traffic accounting and path monitoring

ABSTRACT

A method is performed at a router configured to perform Bit Index Explicit Replication (BIER) for forwarding of multicast packets in a network. The method includes, upon receiving a multicast packet of a multicast flow, accessing flow mappings in which multicast flows are mapped to fixed accounting values corresponding to the multicast flows. The method further comprises generating a BIER header for the multicast packet by encoding a multi-segment entropy field of the BIER header with (i) a variable entropy value for equal-cost multi-path (ECMP) load balancing, and (ii) a fixed accounting value among the fixed accounting values that is mapped to the multicast flow in the flow mappings. The method also includes encapsulating the multicast packet with the BIER header to produce an encapsulated multicast packet, and forwarding the encapsulated multicast packet.

TECHNICAL FIELD

[ow] The present disclosure relates generally to Bit Index ExplicitReplication (BIER) networks.

BACKGROUND

The BIER Request for Comments (RFC) 8279 for Multicast Using Bit IndexExplicit Replication (BIER) defines an architecture for the forwardingof multicast data packets according to BIER procedures. The BIERprocedures encapsulate multicast traffic flows (i.e., multicast flows)with a BIER header defined in the RFC. The BIER header encodes abitstring in the BIER header to identify egress routers of a BIERnetwork. Routers of the BIER network forward the multicast flows towardthe egress routers based on the bitstring. The BIER header does notinclude per-flow state information, and the routers do not generate ormaintain per-flow state information when acting in accordance with theBIER procedures defined in the RFC. In the absence of per-router,per-flow state information, monitoring and tracing of the multicastflows in the BIER network for accounting purposes is difficult.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of a network environment that includes a BIERnetwork for forwarding multicast traffic using either existing (i.e.,conventional) BIER procedures, or extended/new BIER procedures presentedherein, according to an embodiment.

FIG. 2 is a block diagram of a BIER topology/network configured toforward multicast traffic using existing BIER procedures.

FIG. 3 is an illustration of an existing BIER packet with MultiprotocolLabel Switching (MPLS) encapsulation.

FIG. 4 is an illustration of a new BIER header used with the extendedBIER procedures, according to an embodiment.

FIG. 5 is a block diagram of a network system configured to forwardmulticast traffic using the extended BIER procedures and the new BIERheader, according to an embodiment.

FIG. 6 shows a table of flow mappings configured to map multiplemulticast flows to (shortened entropy value, fixed value) tuples ofmultiple multi-segment entropy fields of the new BIER header, accordingto an embodiment.

FIG. 7 is a flowchart of a method of multicast (BIER) traffic accountingand path service level agreement (SLA) monitoring performed by aningress router in a BIER domain, according to an embodiment.

FIG. 8 is a flowchart of a method of multicast (BIER) traffic accountingand path SLA monitoring performed by a transit router or an egressrouter in the BIER domain, according to an embodiment.

FIG. 9 is a block diagram of a network device, representative of a BIERrouter in a BIER network, according to an embodiment.

DESCRIPTION OF EXAMPLE EMBODIMENTS

Overview

In an embodiment, a method is performed at a router configured toperform Bit Index Explicit Replication (BIER) forwarding of multicastpackets in a network. The router may be an ingress router of thenetwork. The method includes, upon receiving a multicast packet of amulticast flow, accessing flow mappings in which multicast flows aremapped to fixed accounting values corresponding to the multicast flows.The method further comprises generating a BIER header for the multicastpacket by encoding a multi-segment entropy field of the BIER header with(i) a variable entropy value for equal-cost multi-path (ECMP) loadbalancing, and (ii) a fixed accounting value among the fixed accountingvalues that is mapped to the multicast flow in the flow mappings. Themethod also includes encapsulating the multicast packet with the BIERheader to produce a BIER packet, and forwarding the BIER packet.

In another embodiment, a method is performed at a router configured toperform BIER forwarding of multicast packets in a network. The routermay be a transit router of the network. The method includes receiving amulticast packet encapsulated with a BIER header including amulti-segment entropy field. The multi-segment entropy field is encodedwith (i) an entropy value for ECMP forwarding, and (ii) a fixedaccounting value that is mapped to a multicast flow to which themulticast packet belongs. The method also includes retrieving the fixedaccounting value from the multi-segment entropy field, and sending, to anetwork controller, a message including an identifier of the router andthe fixed accounting value, to enable the network controller to trace anetwork path of the multicast flow. The method further includesforwarding the multicast packet encapsulated with the BIER header.

EXAMPLE EMBODIMENTS

As mentioned above, limitations of existing (i.e., conventional) BIERprocedures make it difficult to monitor multicast flows in a BIERnetwork. Existing BIER procedures and their shorting comings aredescribed below in connection with FIGS. 1-3. Embodiments presentedherein provide extended or enhanced BIER procedures to overcome suchlimitations. The extended BIER procedures support a networkconfiguration management (NCM) framework for BIER traffic accounting andservice level agreement (SLA) monitoring. The extended BIER proceduresare presented below in connection with FIGS. 4-8.

Referring first to FIG. 1, there is a block diagram of an examplenetwork environment 100 in which multicast flow monitoring/accounting isuseful to network operators. Network environment 100 includes customer(Cust) networks 102(1)-102(4) (collectively referred to as customernetworks 102), service provider (SP) networks 104(1)-104(4)(collectively referred to as SP networks 104) connected to the customernetworks, and a BIER network 106 (also referred to as a transit network)connected to the SP networks. SP networks 104 provide customer networks102 with access to BIER network 106. Customer A operates customernetworks 102(1) and 102(2), customer B operates customer networks 102(3)and 102(4), service provider SP-1 operates SP networks 104(1) and104(2), and service provider SP-2 operates SP networks 104(3) and104(4). Customer networks 102 may include local area networks (LANs)segmented into virtual private networks (VPNs), for example. Inaddition, BIER network 106 may be associated with one or more LANs andone or more wide area networks (WANs), such as the Internet.

Customer networks 102 communicate with each other over BIER network 106.That is, customer networks 102 send traffic to each other over BIERnetwork 106. In an example, client/customer equipment connected tocustomer networks 102 originate multicast traffic (e.g., flows of IPmulticast packets), and BIER network 106 forwards the multicast traffic(also referred to as both multicast flows and BIER traffic) between thecustomer networks in accordance with BIER procedures. The multicastflows may or may not be associated with various VPNs. Ideally, BIERnetwork 106 provides multicast flow accounting information to satisfy awide range of SLA requirements. For example, such information may beused to perform accounting for the multicast flows forwarded by the BIERnetwork from end-to-end, i.e., from ingress/egress of the multicastflows to/from the BIER network. Such accounting may include performingaccounting for billing on a per-router, per-flow, and per-VPN basis,recording/tracing an end-to-end path taken per-flow, and recordingtiming jitter and end-to-end latency per-flow. Also, some use casesbenefit from monitoring a set of multicast flows, where the set ofmulticast flows originate from an ingress router of BIER network 106.

Disadvantageously, when BIER network 106 operates according to existingBIER procedures as defined in the RFC, the BIER network does notgenerate the above-mentioned accounting information when forwardingmulticast flows. One reason for this is that an existing BIER header(defined in the RFC), used to forward multicast packets encapsulatedwith the existing BIER header, does not include or record per-flow stateinformation. Moreover, to save time, transit routers in the BIER networkdo not parse multicast packets beyond the existing BIER header, and thusdo not discover multicast flow state information. Such shortcomings aredescribed more fully below in connection with FIG. 2.

With reference to FIG. 2, there is a block diagram of an example BIERtopology 200 (also referred to as a BIER network 200) corresponding toBIER network 106. Bier Topology 200 is useful for describing theexisting BIER procedures for forwarding multicast flows in a BIERdomain. BIER topology 200 includes BIER routers R1-R6 connected to eachother over various network links, as shown. More generally, routersR1-R6 represent network devices or nodes, such as routers, switches, andthe like, that may be implemented in hardware or virtually, e.g., asnetwork device applications hosted on servers. A source S of multicasttraffic is connected to router R1, and customer equipment CE1, CE2, andCE3 (or multicast receivers CE1-CE3 of multicast traffic) are connectedto routers R4, R6, and R5, respectively. Source S and multicastreceivers CE1-CE3 represent external equipment, such as user equipmentor client devices connected to customer networks 102, described above.Routers R1 and R4-R6 are also referred to as “edge” routers because theysit at the edge of BIER topology 200 and connect to the externalequipment (e.g., source S and each receiver CEi) as shown. Generally,source S originates multicast flows of IP multicast packets destined forreceivers CE1-CE3, and sends the multicast flows to router R1. Acting asa source or ingress router for BIER topology 200, router R1 forwards themulticast flows to routers R4, R5, and R6, which act as egress routersfor the BIER topology to forward the multicast flows to receivers CE1,CE3, and CE2, respectively. Routers R2 and R3 are transit orintermediate routers that are neither ingress nor egress routers.

Routers R1-R6 are each configured or provisioned with BIER informationincluding, but not limited to: a bit-forwarding router (BFR)-prefix(PFX) (BFR-PFX), which identifies the router in the BIERtopology/network; a local range that is allocated to the router so thatthe router can perform forwarding of traffic using BIER overMultiprotocol Label Switching (MPLS), for example; a uniqueBFR-Identifier (ID) (BFR-ID) that is assigned to the router; and a BIERsubdomain list that identifies BIER subdomains of a BIER domain on whichthe router can send and receive traffic.

Prior to routing of multicast flows through BIER topology 200, routersR1-R6 perform Border Gateway Protocol (BGP) auto-discovery (A-D) amongthemselves, for example. During BGP auto-discovery, routers R4-R6 sendto source/ingress router R1 BGP messages that carry respective Inclusive(I)-Provider Multicast Service Interface (PMSI) (I-PMSI) information(e.g., respective routes) for the sending routers R4-R6 (i.e., the“sending” here means originating and sending of BGP messages). Afterauto-discovery, routers R4, R5, and R6 receive from their connectedcustomer equipment respective multicast group membership joins (e.g.,Internet Group Management Protocol (IGMP) membership joins) 204, 206,and 205, and forward their respective membership joins to router R1.Each membership join includes a pair or tuple (source address (S), groupaddress (G)) identifying a multicast flow, for example.

Based on the membership joins, R4-R6 express interest in receiving thefollowing multicast flows:

-   -   a. R4 expresses interest in receiving three multicast flows        F1=(S1, G1), F2=(S1, G2), and F3=(S1, G3), where S1=10.1.1.1,        G1=232.1.1.1, G2=232.1.1.2, and G3=232.1.1.3.    -   b. R5 expresses interest in receiving only multicast flow F2.    -   c. R6 expresses interest in receiving only multicast flow F1.

Auto-discovery establishes protocol independent multicast (PIM) routesPR at ingress router R1. After auto-discovery, ingress router R1receives multicast packets (e.g., IP multicast packets) for each ofmulticast flows F1-F3. The multicast packets include (S, G) tuples toidentify the multicast flows to which they belong. Ingress router R1encapsulates each multicast packet with an existing BIER header encodedwith an initial forwarding bitstring (e.g., 101000 for flow F1, 110000for flow F2, and 001000 for flow F3) to produce an encapsulatedmulticast packet (also referred to as a BIER packet). The forwardingbitstring (referred to simply as the “bitstring”) in the existing BIERheader identifies all of the egress routers that expressed interest inreceiving the multicast flow to which the multicast packet belongs.Ingress router R1 forwards the BIER packets to one or more of next hoptransit routers R2 and R3 for subsequent forwarding of the BIER packetsto each of egress routers R4-R6 interested in receiving the BIERpackets.

Upon receiving each BIER packet, transit routers R2 and R3 performreplication and forwarding of the BIER packet toward egress routersR4-R6 based only on the bitstring in the existing BIER header. That is,transit routers R2 and R3 do not look/parse beyond the existing BIERheader to perform the forwarding. As a result, transit routers R2 and R3do not access either (i) per-flow state information (e.g., tuple (S, G))in the multicast packet identifying the multicast flow to which themulticast packet belongs, or (ii) VPN information, e.g., a VPN label,identifying the VPN associated with the multicast flow. When egressrouters R4-R6 receive the BIER packet, the egress routers decapsulatethe BIER packet to recover its payload, i.e., the multicast packet, andforward the multicast packet to the receivers connected to the egressrouters.

With reference to FIG. 3, there is a diagram of an example BIER packet300 with MPLS encapsulation. BIER packet 300 includes a payload 304,which may be an IP multicast packet that includes an (S, G) tuple (notshown) identifying a multicast flow. BIER packet 300 further includes:an optional VPN label 306 encapsulating the payload and identifying aVPN associated with the multicast flow (S, G); an existing BIER header308 encapsulating the payload and optional VPN label; a BIER or MPLSlabel 310; and an Ethernet header 312 encapsulating all of thepreviously listed fields. In some examples, the combination of onlypayload 304, optional VPN label 306, and existing BIER header 308 may bereferred to as the BIER packet.

As shown in an expanded view in FIG. 3, existing BIER header 308includes a bitstring field 320 encoded with the bitstring, describedabove. Each bit in the bitstring represents exactly one of the egressrouters of a BIER domain; thus, to ensure forwarding of the multicastpacket to a set of egress routers (e.g., routers R4-R6), an ingressrouter (e.g., router R1) sets the bits of the bitstring corresponding tothose routers. Existing BIER header 308 also includes an entropy field330 (e.g., of 16-18 bits) that is encoded with an entropy value. Routersin the BIER domain employ an entropy technique that uses the entropyvalue to achieve load balancing over equal-cost multi-path (ECMP)forwarding paths. This is referred to as equal-cost or ECMP loadbalancing. Each router may update the entropy value in the BIER headerwith hash values as the BIER packet is forwarded hop-to-hop. Thus, theentropy value may vary as the multicast packet is forwarded through theBIER domain.

Existing BIER header 308 also includes an unused reserved field 340, aversion field 342, a length field 344, a BFR-ID 346, an operations,administration, and maintenance (OAM) field 348, and a next protocol(Proto) field 350 encoded with respective values as defined in theexisting BIER procedures.

The embodiments presented herein introduce extended BIER procedures thatextend the existing BIER procedures to overcome the limitationsdescribed above and provide numerous other advantages. The extended BIERprocedures define an extended or “new” BIER header described below inconnection with FIG. 4. The new BIER header facilitates monitoring ofmulticast flows by routers in the BIER domain, without the need for deeppacket inspection of BIER packets traversing the routers. The new BIERheader reuses some of the fields of the existing BIER header, but doesnot change the extent or size of the fields, and maintains existingfunctionality associated with all of the fields of the existing BIERheader. Thus, the changes manifested in the new BIER header minimize theneed for network management upgrades. In the ensuing description, thenew BIER header is described in connection with FIG. 4, and extendedBIER procedures that use the new BIER header are described in connectionwith FIG. 5-8.

As used herein, the terms “encode” and “include” and their respectivederivations may be considered synonymous and equivalent. For example, afield “encoded” with a value means the same as the value being“included” in the field, and that the field “includes” the value.Similarly, “encoding” a value in a field means the same as “including”or “populating” the value in the field, and so on.

With reference to FIG. 4, there is an illustration of a new BIER header400, according to an embodiment. New BIER header 400 optionally modifiesthe entropy field of existing BIER header 308. More specifically, newBIER header 400 optionally includes a multi-segment entropy field 402encoded with multi-segment values by an ingress router of the BIERdomain. More specifically, multi-segment entropy field 402 includes afirst segment 404 encoded with a shortened, variable entropy value usedfor ECMP load balancing, and a second segment 406 encoded with a fixedentropy value (also referred to as a “fixed accounting value” or, moresimply, a “fixed value”) used for multicast flow accounting. While theshortened entropy value may change at each router when a multicastpacket encapsulated with new BIER header 400 is forwarded in the BIERdomain, the fixed value remains fixed or constant at each router. Theshortened entropy value and the fixed value may each be a respective8-bit integer value, for example. In a first example, the fixed valuerepresents or identifies a multicast flow that is mapped to the fixedvalue. As such, the fixed value represents an abbreviated multicast flowidentifier (ID) that is not a typical (S, G) tuple/ID for the multicastflow in the IP domain. In a second example, the fixed value representsor identifies a VPN to which one or more multicast flows belong. Assuch, the fixed value represents an abbreviated VPN ID that is not atypical VPN ID. Alternatively, the fixed value may be a typical VPN ID.Use of multi-segment entropy field 402 is optional. That is, in someembodiments, new BIER header 400 may simply retain entropy field 330 ofexisting BIER header 308.

New BIER header 400 also makes use of reserved field 340 of the existingBIER header. More specifically, in new BIER header 400, reserved field340 includes a timestamp field 408 encoded with an egress timestamp byan ingress router to indicate a time when forwarding of a multicastpacket encapsulated with the new BIER header from the ingress routeroccurs, an accounting flag 410 set by the ingress router to indicatewhether multi-segment entropy field 402 includes the fixed value (e.g.,the multicast flow ID or the VPN ID), and a timing (or timestamp) flag412 set by the ingress router to indicate whether timestamp field 408includes the egress timestamp. The egress timestamp corresponds to whenthe egress router forwards a BIER packet with the new BIER header 400 toa next hop router. Once the ingress router has forwarded a BIER packetincluding new BIER header 400, the fixed value, the egress timestamp,and flags 410 and 412 remain unchanged or fixed at each next hop router.Encoding of egress timestamp field 408 with the egress timestamp isoptional.

For accounting flag 410, in an example, a value=1 may indicate thatmulti-segment entropy field 402 includes the fixed value (e.g.,multicast flow ID or VPN ID), and that routers at each hop are toperform multicast flow accounting based on the fixed value, and reporttheir accounting results. Alternatively, a value=0 may indicate thatmulti-segment entropy field 402 does not include the fixed value (i.e.,that the new BIER header includes existing entropy field 330), and thatmulticast flow accounting at each hop is not to be performed. For timingflag 412, in an example, a value=1 may indicate that timestamp field 408includes an egress timestamp and that routers at each hop are to performpacket timing operations using the egress timestamp, and report timingresults. Alternatively, a value=0 may indicate that timestamp field 408does not include the egress timestamp and that routers at each hop donot perform the packet timing operations using an egress timestamp setby the ingress router.

With reference to FIG. 5, there is a block diagram of a network system500 useful for describing the extended BIER procedures that use new BIERheader 400. Network system 500 includes BIER topology 502, a networkcontroller 504 to communicate with and control routers of the BIERtopology, and an administrator application 506 (also referred to simplyas an administrator) to communicate with the network controller. BIERtopology 502 is configured similarly to BIER topology 200, except thatBIER topology 502 is configured to operate in accordance with theextended BIER procedures described below.

At 520, administrator 506 provides an instruction to network controller504 to perform SLA monitoring of one or more multicast flows. Also,administrator 506 may instruct network controller 504 to monitor allmulticast flows under each of one or more VPNs. In the example of FIG.5, administrator 506 instructs network controller 504 to monitormulticast flow (S, G)=(10.1.1.1, 232.1.1.1) corresponding to multicastflow F1.

Upon receiving the instruction(s) from administrator 506, at 521,network controller 504 may assign a unique fixed value to each of themulticast flows. For example, for purposes of monitoring multiple firstmulticast flows belonging to a first VPN, multiple second multicastflows belonging to a second VPN, and so on, network controller 504 mayassign a first fixed value (e.g., the same fixed value) to each of thefirst multicast flows (i.e., the first fixed value is the same acrossthe first multicast flows) belonging to the first VPN, a second fixedvalue different from the first fixed value to each of the secondmulticast flows belonging to the second VPN, and so on. Networkcontroller 504 generates and stores flow mappings of the multicast flows(i.e., their identifiers) to their corresponding/assigned fixed values,and to the VPNs to which the multicast flows belong, when applicable. Inthe example of FIG. 5, network controller 504 simply assigns a uniquefixed value 1234567 to multicast flow F1, and stores a mapping of anidentifier of multicast flow F1 (e.g., the (S, G) tuple for multicastflow F1) to the fixed value 1234567 assigned/corresponding to thatmulticast flow. Network controller 504 may use any technique to generatethe fixed values to be assigned to multicast flows. For example, networkcontroller may generate the fixed values as random numbers, or access apredetermined set of the fixed values. In the case of assigning thefixed value to a VPN, the fixed value may or may not be the VPN ID.

At 522, network controller 504 sends to ingress router R1 a message thatinforms the ingress router that SLA monitoring (e.g., flow accounting)is to be performed for multicast flow F1. The message includes themapping of multicast flow F1 (e.g. its (S, G) tuple) to fixed value1234567. In another embodiment, ingress router R1 may receive theinstruction(s) to monitor multicast flows (e.g., multicast flow F1)directly from network controller 504, without a corresponding mapping,in which case the ingress router generates the fixed value(s) andestablishes the multicast flow-to-fixed value(s) mapping(s) describedabove.

Router R1 receives the message from network controller 504, and receivesmulticast flows F1-F3 from source S. Based on the message from networkcontroller 504, at 530, router R1 performs the following operations foreach multicast packet in multicast flow F1. Router R1 generates a newBIER header (e.g., new BIER header 400) for the multicast packet, andencodes the appropriate forwarding bitstring into field 320 of the newBIER header. Router R1 also encodes the fixed value 1234567 mapped tomulticast flow F1 into second segment 406 of multi-segment entropy field402 of the new BIER header, and sets accounting flag 410 to a value(e.g., 1) that indicates that the new BIER header includes the fixedvalue, in order to trigger next hop routers to perform flow accountingfor multicast flow F1. Router R1 also encodes first segment 404 with ashortened entropy value to be used for ECMP load balancing.

When router R1 encapsulates the multicast packet with the new BIERheader to produce an encapsulated multicast packet/BIER packet, therouter encodes an egress timestamp into timestamp field 408 of the newBIER header, and sets timing flag 412 to a value that indicates thepresence of the egress timestamp. Router R1 forwards the BIER packet toa next hop router (e.g., router R2). The egress timestamp represents atime when router R1 forwards the BIER packet to the next hop router.

Over time, router R1 generates flow monitoring information for multicastflow F1. For example, router R1 employs counters to count a number ofmulticast packets for multicast flow F1 that are received at the router(i.e., an ingress packet count), a number of multicast packets of themulticast flow that are forwarded by the router (i.e., an egress packetcount), elapsed times that the multicast packets spend at the router(e.g., a difference between an egress time and an ingress time for eachof the multicast packets), and so on. Router R1 periodically sends tonetwork controller 504 messages or reports that each include anidentifier of router R1 and the flow monitoring information. Theidentifier of router R1 may include a BFR-ID, an IP address, and so on.The flow monitoring information may include the ingress and egresspacket counts, the elapsed times, current egress timestamps, and so on.

Router R1 processes the multicast packets of remaining multicast flowsF2-F3 in accordance with the existing BIER procedures as described abovein connection with FIGS. 2 and 3. This includes encapsulating themulticast packets with an existing BIER header, and forwarding theresulting BIER packets to next hop router R2.

Next hop (transit) router R2 receives the BIER packets for multicastflows F1-F3 forwarded by ingress router R1. Upon receiving the BIERpackets, at 540, router R2 performs the following operations on eachBIER packet. Router R2 parses the various fields of the BIER header toretrieve their values, but does not parse the BIER packet any deeperthan the BIER header. Router R2 examines accounting flag 410 in the BIERheader to determine whether multi-segment entropy field 402 is encodedwith a fixed value. When accounting flag 410 indicates that the fixedvalue is present (and that the BIER header is a new BIER header insteadof the existing/conventional BIER header), router R2 retrieves oraccesses the fixed value from the multi-segment entropy field andgenerates flow monitoring information for the multicast flow associatedwith the fixed value. For example, similar to router R1, router R2maintains counters to count ingress and egress packet counts for similarBIER packets that include the fixed value, and to track elapsed timesthat those packets spend at the router. Router R2 sends to networkcontroller 520 one or more messages or reports that each include anidentifier of router R2, the fixed value, and the monitoringinformation. When accounting flag 410 indicates that the fixed value isnot present, router R2 does not perform the aforementioned accessing andreporting based on the fixed value.

Router R2 also examines timing flag 412 in the BIER header to determinewhether the BIER header is encoded with an egress timestamp. When timingflag 412 indicates that the egress timestamp is present, next hop routerR2 retrieves the egress timestamp and computes a total transit time ofthe BIER packet from when ingress router R1 forwarded the BIER packet towhen router R2 received the BIER packet, based on the egress timestamp.For example, router R2 may compute the total transit time as a timedifference between the egress timestamp and an ingress time (or anegress time) of the BIER packet at (or from) router R2. Router R2 sendsto network controller 504 a message or report that includes theidentifier of router R2, the egress timestamp, and the total transittime. When timestamp flag 412 indicates that the egress timestamp is notpresent, next hop router R2 does not perform the aforementioned totaltransit time computation and reporting.

In the example of FIG. 5, for multicast flow F1, accounting flag 410indicates the presence of the fixed value 1234567, and timing flag 412indicates the presence of the egress timestamp in the BIER header.Accordingly, accounting flag 410 and timing flag 412 trigger router R2to perform the monitoring, transit time computing, and reportingoperations described above on the BIER packets of multicast flow F1. Themessages or reports sent by router R2 to network controller 504 eachinclude the identifier of router R2 and the fixed value 1234567 thatspecifically associates the information in the reports with multicastflow F1. In contrast, for multicast flows F2 and F3, accounting flag 410indicates the BIER header is not encoded with a fixed value, and timingflag 412 indicates the BIER header is not encoded with the egresstimestamp. Accordingly, for multicast flows F2 and F3, router R2 doesnot perform the monitoring, transit time computing, and reportingdescribed above for multicast flows F1.

After performing the operations described above, router R2 forwards theBIER packets for multicast flows F1-F3 to their next hop destinationsbased on the bitstrings in the BIER headers of the BIER packets. Forexample, router R2 forwards the BIER packets to transit router R3,egress router R5, and so on. Operations 540 described above with respectto router R2 are repeated at each next hop transit router (e.g., routerR3) traversed by the BIER packets of multicast flows F1-F3, until theBIER packets are forwarded to the egress routers, which decapsulate theBIER packets and forward the payloads (e.g., IP multicast packets) tothe customer equipment. In an embodiment, the egress routers may eachalso perform operations 540 prior to decapsulating the BIER headers.

Network controller 504 receives the above-mentioned reports sent by therouters of BIER topology 502 and, at 550, performs the followingoperations based on the reports. Network controller 504 accesses thefixed value (e.g., 1234567) included in the reports, and determines thatthe fixed value is mapped to multicast flow F1 based on the fixedvalue-to-multicast flow mapping (i.e., the flow mapping) previouslyestablished by network controller at operation 521. Based on the flowmapping, network controller 504 associates the information in thereports (that carry the fixed value) with multicast flow F1. Formulticast flow F1, network controller 504 generates an accounting reportbased on the information in the reports.

For example, network controller 504 may tabulate or compute a totalnumber of multicast packets handled at each router, elapsed times ateach router, total transit times from ingress router R1 to each otherrouter, an end-to-end transit time, and so on, and include those resultsin the report. Network controller 504 may also compute timing jitter andlatency per-flow (e.g., for multicast flow F1), bits per second (bps)per-flow, and total traffic in bytes per-flow.

Network controller 504 may also generate a trace 560 of multicast flowF1 through BIER topology 502 based on the information (e.g., routeridentifiers) in the reports. Trace 560 defines a path (which may berepresented in tree form) taken by multicast flow F1 through BIERtopology 502. The path identifies each hop (e.g., router) of BIERtopology 502 traversed by multicast packets of multicast flow F1.

With reference to FIG. 6, there is shown a table 600 of example flowmappings in which multiple multicast flows (S1, G1)-(S7, G7) (i.e.,identifiers of the multicast flows) are mapped to tuples (shortenedentropy value, fixed accounting value) of multiple multi-segment entropyfields 606(1)-606(7) (each corresponding to multi-segment entropy field402). The flow mappings may be established by network controller 504 oringress router R1 based on requests from administrator 506, as describedabove. Multi-segment entropy fields 606(1)-606(7) may be encoded intonew BIER header 400 of respective BIER packets, as described above.

In the example of FIG. 6, table 600 includes columns A-C. Column Aincludes entries or rows identifying multicast flows (S1, G1)-(S7, G7).Column B includes short entropy values for ECMP load balancing (e.g.,100, 101, 102, and so on) corresponding/assigned to the multicast flows(e.g., (S1, G1), (S2, G2), (S3, G3), and so on). The short entropyvalues are to be encoded into first segment 404 (referred to as the1^(st) half) of multi-segment entropy field 402 of new BIER header 400.Column C includes fixed accounting values (e.g., 333 or 444)corresponding/assigned to the multicast flows. The fixed accountingvalues are to be encoded into second segment 406 (referred to as the2^(nd) half) of multi-segment entropy field 402. In the example of FIG.6, the multicast flows of column A are divided into two distinct sets orgroups of multicast flows including a first set of multicast flows (S1,G1)-(S4, G4) and a second set of multicast flows (S5, G5)-(S7, G7). Thefirst and second sets of multicast flows are mapped to distinct fixedvalues 333 and 444, respectively. In an example, fixed values 333 and444 may represent, and be mapped to, distinct VPN IDs to which themulticast flows belong. In other words, the multicast flows are dividedinto distinct sets of multicast flows that are associated with distinctVPNs.

With reference to FIG. 7, there is a flowchart of an example method 700of BIER traffic accounting and path SLA monitoring that may be performedby an ingress router in a BIER domain. Various operations of method 700are described above.

1. At 702, the router receives a multicast packet of a multicast flow,and accesses flow mappings in which multicast flows are mapped todistinct fixed accounting values corresponding to the multicast flows.In an example, the flow mappings include (S, G) identifiers of themulticast flows that are mapped to the fixed accounting values. In anexample, the fixed values are each mapped to a respective one of themulticast flows. In another example, the fixed values are each mappedto/across multiple ones of the multicast flows. The fixed accountingvalues may include one or more VPN identifier for VPNs that include themulticast flows. Thus, the fixed accounting values may be said to map tothe multicast flows directly or indirectly (e.g., via a VPN identifier).

At 704, the router determines whether the multicast packet belongs toany of the multicast flows in the flow mappings. In an example, thedetermining includes matching an (S, G) identifier of the multicastpacket to the (S, G) identifiers of the flow mappings. When it isdetermined that the multicast packet belongs to the multicast flow basedon the flow mappings, flow proceeds to 706. When it is determined thatthe multicast packet does not belong to any of the multicast flows inthe flow mappings, flow proceeds to 716.

At 706, the router generates a new BIER header for the multicast packet.The new BIER header includes a multi-segment entropy field that includesa first segment and a second segment. The router (i) encodes the firstsegment of the multi-segment entropy field with a variable entropy valuefor ECMP load balancing, and (ii) encodes the second segment of themulti-segment entropy field with a fixed accounting value among thefixed accounting values that is mapped to the multicast flow in the flowmappings. More generally, the router encodes the multi-segment entropyfield with (i) the variable entropy value for ECMP loadbalancing/forwarding, and (ii) the fixed accounting value mapped to themulticast flow.

At 708, the router optionally encodes an egress timestamp into a timingfield of the new BIER header.

At 710, the router encodes the new BIER header with (i) an accountingflag set to indicate the presence of the fixed accounting value and,when the egress timestamp is present, (ii) a timing flag set to indicatethe presence of the egress timestamp in the new BIER header.

At 712, the router encodes remaining fields of the new BIER header withconventional BIER information used for BIER forwarding of multicastpackets, such as a bitstring that identifies egress routers, and so on.The router encapsulates the multicast packet with the new BIER header toproduce an encapsulated multicast packet (i.e., a BIER packet).

At 714, the router forwards the encapsulated multicast packet accordingto the existing BIER procedures.

At 716, the router encapsulates the multicast packet with a conventionalBIER header (i.e., a BIER header as defined under the existing BIERprocedures) to produce an encapsulated multicast packet (i.e., BIERpacket). Flow then proceeds to 714 to forward the encapsulated multicastpacket.

With reference to FIG. 8, there is a flowchart of an example method 800of BIER in-band traffic accounting and path SLA monitoring that may beperformed by a transit router or an egress router in a BIER domain.Various operations of method 800 are described above.

At 802, the router receives an encapsulated multicast packet (i.e., amulticast packet encapsulated with a BIER header). In an example, theBIER header is a new BIER header. The new BIER header includes anaccounting flag to indicate whether the new BIER header includes a fixedaccounting value in a second segment of a multi-segment entropy field ofthe new BIER header. The new BIER header also includes a timing flag toindicate whether the new BIER header includes an egress timestamp thatwas stored in the new BIER header previously by an ingress router.

At 804, the router determines whether the new BIER header includes thefixed accounting value based on the accounting flag in the new BIERheader. When the new BIER header includes the fixed accounting value,flow proceeds to 806. When the new BIER header does not include thefixed accounting value, flow proceeds to 808.

At 806, the router retrieves the fixed accounting value from the secondsegment of the multi-segment entropy field. The router reports, to anetwork controller, a message including an identifier of the router andthe fixed accounting value to enable the network controller to trace anetwork path of the multicast flow.

At 808, the router determines whether the new BIER header includes theegress timestamp based on the timing flag in the new BIER header. Whenthe new BIER header includes the egress timestamp, flow proceeds to 810.When the new BIER header does not include the egress timestamp, flowproceeds to 812.

At 810, the router retrieves the egress timestamp. The router computes atotal transit time of the multicast packet from the ingress router tothe router based on the egress timestamp and an ingress time or anegress time of the multicast packet at the router. The router sends, toa network controller, a message including the egress timestamp and thetotal transit time. Flow proceeds to 812.

At 812, the router retrieves an entropy value from a first segment ofthe multi-segment entropy field, and performs ECMP forwarding of themulticast packet encapsulated with the new BIER header based on theentropy value.

Referring to FIG. 9, FIG. 9 illustrates a hardware block diagram of acomputing device 900 that may perform functions associated withoperations discussed herein in connection with the techniques depictedin FIGS. 1-8. In various embodiments, a computing device, such ascomputing device 900 or any combination of computing devices 900, may beconfigured as any entity/entities as discussed for the techniquesdepicted in connection with FIGS. 1-8 in order to perform operations ofthe various techniques discussed herein. For example, computing device900 may operate as a network device representative of each of routersR1-R6 that perform the existing and the extended BIER procedures,described above.

In at least one embodiment, the computing device 900 may include one ormore processor(s) 902, one or more memory element(s) 904, storage 906, abus 908, one or more network processor unit(s) 910 interconnected withone or more network input/output (I/O) interface(s) 912, one or more I/Ointerface(s) 914, and control logic 920. In various embodiments,instructions associated with logic for computing device 900 can overlapin any manner and are not limited to the specific allocation ofinstructions and/or operations described herein.

In at least one embodiment, processor(s) 902 is/are at least onehardware processor configured to execute various tasks, operationsand/or functions for computing device 900 as described herein accordingto software and/or instructions configured for computing device 900.Processor(s) 902 (e.g., a hardware processor) can execute any type ofinstructions associated with data to achieve the operations detailedherein. In one example, processor(s) 902 can transform an element or anarticle (e.g., data, information) from one state or thing to anotherstate or thing. Any of potential processing elements, microprocessors,digital signal processor, baseband signal processor, modem, PHY,controllers, systems, managers, logic, and/or machines described hereincan be construed as being encompassed within the broad term ‘processor’.

In at least one embodiment, memory element(s) 904 and/or storage 906is/are configured to store data, information, software, and/orinstructions associated with computing device 900, and/or logicconfigured for memory element(s) 904 and/or storage 906. For example,any logic described herein (e.g., control logic 920) can, in variousembodiments, be stored for computing device 900 using any combination ofmemory element(s) 904 and/or storage 906. Note that in some embodiments,storage 906 can be consolidated with memory element(s) 904 (or viceversa), or can overlap/exist in any other suitable manner.

In at least one embodiment, bus 908 can be configured as an interfacethat enables one or more elements of computing device 900 to communicatein order to exchange information and/or data. Bus 908 can be implementedwith any architecture designed for passing control, data and/orinformation between processors, memory elements/storage, peripheraldevices, and/or any other hardware and/or software components that maybe configured for computing device 900. In at least one embodiment, bus908 may be implemented as a fast kernel-hosted interconnect, potentiallyusing shared memory between processes (e.g., logic), which can enableefficient communication paths between the processes.

In various embodiments, network processor unit(s) 910 may enablecommunication between computing device 900 and other systems, entities,etc., via network I/O interface(s) 912 to facilitate operationsdiscussed for various embodiments described herein. In variousembodiments, network processor unit(s) 910 can be configured as acombination of hardware and/or software, such as one or more Ethernetdriver(s) and/or controller(s) or interface cards, Fibre Channel (e.g.,optical) driver(s) and/or controller(s), and/or other similar networkinterface driver(s) and/or controller(s) now known or hereafterdeveloped to enable communications between computing device 900 andother systems, entities, etc. to facilitate operations for variousembodiments described herein. In various embodiments, network I/Ointerface(s) 912 can be configured as one or more Ethernet port(s),Fibre Channel ports, and/or any other I/O port(s) now known or hereafterdeveloped. Thus, the network processor unit(s) 910 and/or network I/Ointerface(s) 912 may include suitable interfaces for receiving,transmitting, and/or otherwise communicating data and/or information ina network environment.

I/O interface(s) 914 allow for input and output of data and/orinformation with other entities that may be connected to computer device900. For example, I/O interface(s) 914 may provide a connection toexternal devices such as a keyboard, keypad, a touch screen, and/or anyother suitable input and/or output device now known or hereafterdeveloped. In some instances, external devices can also include portablecomputer readable (non-transitory) storage media such as databasesystems, thumb drives, portable optical or magnetic disks, and memorycards. In still some instances, external devices can be a mechanism todisplay data to a user, such as, for example, a computer monitor, adisplay screen, or the like.

In various embodiments, control logic 920 can include instructions that,when executed, cause processor(s) 902 to perform operations, which caninclude, but not be limited to, providing overall control operations ofcomputing device; interacting with other entities, systems, etc.described herein; maintaining and/or interacting with stored data,information, parameters, etc. (e.g., memory element(s), storage, datastructures, databases, tables, etc.); combinations thereof; and/or thelike to facilitate various operations for embodiments described herein.

The programs described herein (e.g., control logic 920) may beidentified based upon application(s) for which they are implemented in aspecific embodiment. However, it should be appreciated that anyparticular program nomenclature herein is used merely for convenience;thus, embodiments herein should not be limited to use(s) solelydescribed in any specific application(s) identified and/or implied bysuch nomenclature.

In various embodiments, entities as described herein may storedata/information in any suitable volatile and/or non-volatile memoryitem (e.g., magnetic hard disk drive, solid state hard drive,semiconductor storage device, random access memory (RAM), read onlymemory (ROM), erasable programmable read only memory (EPROM),application specific integrated circuit (ASIC), etc.), software, logic(fixed logic, hardware logic, programmable logic, analog logic, digitallogic), hardware, and/or in any other suitable component, device,element, and/or object as may be appropriate. Any of the memory itemsdiscussed herein should be construed as being encompassed within thebroad term ‘memory element’. Data/information being tracked and/or sentto one or more entities as discussed herein could be provided in anydatabase, table, register, list, cache, storage, and/or storagestructure: all of which can be referenced at any suitable timeframe. Anysuch storage options may also be included within the broad term ‘memoryelement’ as used herein.

Note that in certain example implementations, operations as set forthherein may be implemented by logic encoded in one or more tangible mediathat is capable of storing instructions and/or digital information andmay be inclusive of non-transitory tangible media and/or non-transitorycomputer readable storage media (e.g., embedded logic provided in: anASIC, digital signal processing (DSP) instructions, software[potentially inclusive of object code and source code], etc.) forexecution by one or more processor(s), and/or other similar machine,etc. Generally, memory element(s) 904 and/or storage 906 can store data,software, code, instructions (e.g., processor instructions), logic,parameters, combinations thereof, and/or the like used for operationsdescribed herein. This includes memory element(s) 904 and/or storage 906being able to store data, software, code, instructions (e.g., processorinstructions), logic, parameters, combinations thereof, or the like thatare executed to carry out operations in accordance with teachings of thepresent disclosure.

In some instances, software of the present embodiments may be availablevia a non-transitory computer useable medium (e.g., magnetic or opticalmediums, magneto-optic mediums, CD-ROM, DVD, memory devices, etc.) of astationary or portable program product apparatus, downloadable file(s),file wrapper(s), object(s), package(s), container(s), and/or the like.In some instances, non-transitory computer readable storage media mayalso be removable. For example, a removable hard drive may be used formemory/storage in some implementations. Other examples may includeoptical and magnetic disks, thumb drives, and smart cards that can beinserted and/or otherwise connected to a computing device for transferonto another computer readable storage medium.

Variations and Implementations

Embodiments described herein may include one or more networks, which canrepresent a series of points and/or network elements of interconnectedcommunication paths for receiving and/or transmitting messages (e.g.,packets of information) that propagate through the one or more networks.These network elements offer communicative interfaces that facilitatecommunications between the network elements. A network can include anynumber of hardware and/or software elements coupled to (and incommunication with) each other through a communication medium. Suchnetworks can include, but are not limited to, any local area network(LAN), virtual LAN (VLAN), wide area network (WAN) (e.g., the Internet),software defined WAN (SD-WAN), wireless local area (WLA) access network,wireless wide area (WWA) access network, metropolitan area network(MAN), Intranet, Extranet, virtual private network (VPN), Low PowerNetwork (LPN), Low Power Wide Area Network (LPWAN), Machine to Machine(M2M) network, Internet of Things (IoT) network, BIER network, Ethernetnetwork/switching system, any other appropriate architecture and/orsystem that facilitates communications in a network environment, and/orany suitable combination thereof.

Networks through which communications propagate can use any suitabletechnologies for communications including wireless communications (e.g.,4G/5G/nG, IEEE 802.11 (e.g., Wi-Fi®/Wi-Fib®), IEEE 802.16 (e.g.,Worldwide Interoperability for Microwave Access (WiMAX)),Radio-Frequency Identification (RFID), Near Field Communication (NFC),Bluetooth™, mm.wave, Ultra-Wideband (UWB), etc.), and/or wiredcommunications (e.g., T1 lines, T3 lines, digital subscriber lines(DSL), Ethernet, Fibre Channel, etc.). Generally, any suitable means ofcommunications may be used such as electric, sound, light, infrared,and/or radio to facilitate communications through one or more networksin accordance with embodiments herein. Communications, interactions,operations, etc. as discussed for various embodiments described hereinmay be performed among entities that may directly or indirectlyconnected utilizing any algorithms, communication protocols, interfaces,etc. (proprietary and/or non-proprietary) that allow for the exchange ofdata and/or information.

In various example implementations, entities for various embodimentsdescribed herein can encompass network elements (which can includevirtualized network elements, functions, etc.) such as, for example,network appliances, forwarders, routers, servers, switches, gateways,bridges, loadbalancers, firewalls, processors, modules, radioreceivers/transmitters, or any other suitable device, component,element, or object operable to exchange information that facilitates orotherwise helps to facilitate various operations in a networkenvironment as described for various embodiments herein. Note that withthe examples provided herein, interaction may be described in terms ofone, two, three, or four entities. However, this has been done forpurposes of clarity, simplicity and example only. The examples providedshould not limit the scope or inhibit the broad teachings of systems,networks, etc. described herein as potentially applied to a myriad ofother architectures.

Communications in a network environment can be referred to herein as‘messages’, ‘messaging’, ‘signaling’, ‘data’, ‘content’, ‘objects’,‘requests’, ‘queries’, ‘responses’, ‘replies’, etc. which may beinclusive of packets. As referred to herein and in the claims, the term‘packet’ may be used in a generic sense to include packets, frames,segments, datagrams, and/or any other generic units that may be used totransmit communications in a network environment. Generally, a packet isa formatted unit of data that can contain control or routing information(e.g., source and destination address, source and destination port,etc.) and data, which is also sometimes referred to as a ‘payload’,‘data payload’, and variations thereof. In some embodiments, control orrouting information, management information, or the like can be includedin packet fields, such as within header(s) and/or trailer(s) of packets.Internet Protocol (IP) addresses discussed herein and in the claims caninclude any IP version 4 (IPv4) and/or IP version 9 (IPv6) addresses.

To the extent that embodiments presented herein relate to the storage ofdata, the embodiments may employ any number of any conventional or otherdatabases, data stores or storage structures (e.g., files, databases,data structures, data or other repositories, etc.) to store information.

Note that in this Specification, references to various features (e.g.,elements, structures, nodes, modules, components, engines, logic, steps,operations, functions, characteristics, etc.) included in ‘oneembodiment’, ‘example embodiment’, ‘an embodiment’, ‘anotherembodiment’, ‘certain embodiments’, ‘some embodiments’, ‘variousembodiments’, ‘other embodiments’, ‘alternative embodiment’, and thelike are intended to mean that any such features are included in one ormore embodiments of the present disclosure, but may or may notnecessarily be combined in the same embodiments. Note also that amodule, engine, client, controller, function, logic or the like as usedherein in this Specification, can be inclusive of an executable filecomprising instructions that can be understood and processed on aserver, computer, processor, machine, compute node, combinationsthereof, or the like and may further include library modules loadedduring execution, object files, system files, hardware logic, softwarelogic, or any other executable modules.

It is also noted that the operations and steps described with referenceto the preceding figures illustrate only some of the possible scenariosthat may be executed by one or more entities discussed herein. Some ofthese operations may be deleted or removed where appropriate, or thesesteps may be modified or changed considerably without departing from thescope of the presented concepts. In addition, the timing and sequence ofthese operations may be altered considerably and still achieve theresults taught in this disclosure. The preceding operational flows havebeen offered for purposes of example and discussion. Substantialflexibility is provided by the embodiments in that any suitablearrangements, chronologies, configurations, and timing mechanisms may beprovided without departing from the teachings of the discussed concepts.

As used herein, unless expressly stated to the contrary, use of thephrase ‘at least one of’, ‘one or more of’, ‘and/or’, variationsthereof, or the like are open-ended expressions that are bothconjunctive and disjunctive in operation for any and all possiblecombination of the associated listed items. For example, each of theexpressions ‘at least one of X, Y and Z’, ‘at least one of X, Y or Z’,‘one or more of X, Y and Z’, ‘one or more of X, Y or Z’ and ‘X, Y and/orZ’ can mean any of the following: 1) X, but not Y and not Z; 2) Y, butnot X and not Z; 3) Z, but not X and not Y; 4) X and Y, but not Z; 5) Xand Z, but not Y; 6) Y and Z, but not X; or 7) X, Y, and Z.

Additionally, unless expressly stated to the contrary, the terms‘first’, ‘second’, ‘third’, etc., are intended to distinguish theparticular nouns they modify (e.g., element, condition, node, module,activity, operation, etc.). Unless expressly stated to the contrary, theuse of these terms is not intended to indicate any type of order, rank,importance, temporal sequence, or hierarchy of the modified noun. Forexample, ‘first X’ and ‘second X’ are intended to designate two ‘X’elements that are not necessarily limited by any order, rank,importance, temporal sequence, or hierarchy of the two elements. Furtheras referred to herein, ‘at least one of’ and ‘one or more of’ can berepresented using the ‘(s)’ nomenclature (e.g., one or more element(s)).

In summary, embodiments presented herein provide a framework for in-bandtraffic accounting and path SLA monitoring capability for BIER. Theembodiments provide monitoring capabilities at a granularity ofper-egress traffic accounting, per-flow traffic accounting, per-VPNtraffic accounting, and per-flow latency.

In a first aspect, a method is provided comprising: at a router (whichmay be an ingress router) configured to perform Bit Index ExplicitReplication (BIER) forwarding of multicast packets in a network: uponreceiving a multicast packet of a multicast flow, accessing flowmappings in which multicast flows are mapped to fixed accounting valuescorresponding to the multicast flows; generating a BIER header for themulticast packet by encoding a multi-segment entropy field of the BIERheader with (i) a variable entropy value for equal-cost multi-path(ECMP) load balancing, and (ii) a fixed accounting value among the fixedaccounting values that is mapped to the multicast flow in the flowmappings; encapsulating the multicast packet with the BIER header toproduce a BIER packet; and forwarding the BIER packet.

In a second aspect, an apparatus is provided comprising: multiplenetwork input/output interfaces; and a processor of a router configuredto perform Bit Index Explicit Replication (BIER) forwarding of multicastpackets in a network, the processor coupled to the multiple networkinput/output interfaces and configured to perform: upon receiving amulticast packet of a multicast flow, accessing flow mappings in whichmulticast flows are mapped to fixed accounting values corresponding tothe multicast flows; generating a BIER header for the multicast packetby encoding a multi-segment entropy field of the BIER header with (i) avariable entropy value for equal-cost multi-path (ECMP) load balancing,and (ii) a fixed accounting value among the fixed accounting values thatis mapped to the multicast flow in the flow mappings; encapsulating themulticast packet with the BIER header to produce a BIER packet; andforwarding the BIER packet.

In a third aspect, a non-transitory computer readable medium isprovided. The computer readable medium is encoded with instructionsthat, when executed by a processor of a router configured to perform BitIndex Explicit Replication (BIER) forwarding of multicast packets in anetwork, cause the router to perform: upon receiving a multicast packetof a multicast flow, accessing flow mappings in which multicast flowsare mapped to fixed accounting values corresponding to the multicastflows; generating a BIER header for the multicast packet by encoding amulti-segment entropy field of the BIER header with (i) a variableentropy value for equal-cost multi-path (ECMP) load balancing, and (ii)a fixed accounting value among the fixed accounting values that ismapped to the multicast flow in the flow mappings; encapsulating themulticast packet with the BIER header to produce a BIER packet; andforwarding the BIER packet.

In a fourth aspect, a method is provided comprising: at a router (whichmay be a transit router) configured to perform Bit Index ExplicitReplication (BIER) forwarding of multicast packets in a network:receiving a multicast packet encapsulated with a BIER header including amulti-segment entropy field encoded with (i) an entropy value forequal-cost multi-path (ECMP) forwarding, and (ii) a fixed accountingvalue mapped to a multicast flow to which the multicast packet belongs;retrieving the fixed accounting value from the multi-segment entropyfield; sending, to a network controller, a message including anidentifier of the router and the fixed accounting value to enable thenetwork controller to trace a network path of the multicast flow; andforwarding the multicast packet encapsulated with the BIER header.

The method further comprises: retrieving the entropy value from themulti-segment entropy field, wherein the forwarding includes the ECMPforwarding of the multicast packet based on the entropy value.

The BIER header includes an accounting flag that indicates whether theBIER header includes the fixed accounting value, and the method furthercomprises: determining whether the BIER header includes the fixedaccounting value based on the accounting flag; and when the BIER headerincludes the fixed accounting value, performing the retrieving and thesending.

The method further comprises: when the BIER header does not include thefixed accounting value, not performing the retrieving and the sending.

The BIER header includes a reserved field and the accounting flag isencoded in the reserved field.

The method further comprises: recording an ingress time or an egresstime of the multicast packet at the router; retrieving, from the BIERheader, an egress timestamp encoded in the BIER header by an ingressrouter of the network; computing a transit time of the multicast packetfrom the ingress router to the router based on the egress timestamp andthe ingress time or the egress time; and sending, to the networkcontroller, a second message including the egress timestamp and thetransit time.

The BIER header includes a timing flag that indicates whether the egresstimestamp is encoded in the BIER header, and the method furthercomprises: determining whether the BIER header includes the egresstimestamp based on the timing flag; and when the BIER header includesthe egress timestamp, performing the recording, the retrieving theegress timestamp, the computing, and the sending the second message.

The egress timestamp is encoded in a reserved field of the BIER header.

In a fifth aspect, an apparatus is provided comprising: multiple networkinput/output interfaces; and a processor of a router configured toperform Bit Index Explicit Replication (BIER) forwarding of multicastpackets in a network, the processor coupled to the multiple networkinput/output interfaces and configured to perform: receiving a multicastpacket encapsulated with a BIER header including a multi-segment entropyfield encoded with (i) an entropy value for equal-cost multi-path (ECMP)forwarding, and (ii) a fixed accounting value mapped to a multicast flowto which the multicast packet belongs; retrieving the fixed accountingvalue from the multi-segment entropy field; sending, to a networkcontroller, a message including an identifier of the router and thefixed accounting value to enable the network controller to trace anetwork path of the multicast flow; and forwarding the multicast packetencapsulated with the BIER header.

In a sixth aspect, a non-transitory computer readable medium isprovided. The computer readable medium is encoded with instructionsthat, when executed by a processor of a router configured to perform BitIndex Explicit Replication (BIER) forwarding of multicast packets in anetwork, cause the router to perform: receiving a multicast packetencapsulated with a BIER header including a multi-segment entropy fieldencoded with (i) an entropy value for equal-cost multi-path (ECMP)forwarding, and (ii) a fixed accounting value mapped to a multicast flowto which the multicast packet belongs; retrieving the fixed accountingvalue from the multi-segment entropy field; sending, to a networkcontroller, a message including an identifier of the router and thefixed accounting value to enable the network controller to trace anetwork path of the multicast flow; and forwarding the multicast packetencapsulated with the BIER header.

One or more advantages described herein are not meant to suggest thatany one of the embodiments described herein necessarily provides all ofthe described advantages or that all the embodiments of the presentdisclosure necessarily provide any one of the described advantages.Numerous other changes, substitutions, variations, alterations, and/ormodifications may be ascertained to one skilled in the art and it isintended that the present disclosure encompass all such changes,substitutions, variations, alterations, and/or modifications as fallingwithin the scope of the appended claims.

The descriptions of the various embodiments have been presented forpurposes of illustration, but are not intended to be exhaustive orlimited to the embodiments disclosed. Many modifications and variationswill be apparent to those of ordinary skill in the art without departingfrom the scope and spirit of the described embodiments. The terminologyused herein was chosen to best explain the principles of theembodiments, the practical application or technical improvement overtechnologies found in the marketplace, or to enable others of ordinaryskill in the art to understand the embodiments disclosed herein.

What is claimed is:
 1. A method comprising: at a router configured toperform Bit Index Explicit Replication (BIER) forwarding of multicastpackets in a network: upon receiving a multicast packet of a multicastflow, accessing flow mappings in which multicast flows are mapped tofixed accounting values corresponding to the multicast flows; generatinga BIER header for the multicast packet by encoding a multi-segmententropy field of the BIER header with (i) a first segment that includesa variable entropy value for equal-cost multi-path (ECMP) loadbalancing, and (ii) a second segment that includes a fixed accountingvalue among the fixed accounting values that is mapped to the multicastflow in the flow mappings; encoding a reserved field of the BIER headerwith an accounting flag configured to indicate that the multi-segmententropy field includes the fixed accounting value, and to trigger nexthop BIER routers to perform flow accounting for the multicast flow andreporting accounting results along with the fixed accounting value;encapsulating the multicast packet with the BIER header to produce aBIER packet; and forwarding the BIER packet.
 2. The method of claim 1,further comprising, at the router: determining whether the multicastpacket belongs to any of the multicast flows in the flow mappings; andwhen the multicast packet belongs to the multicast flow in the flowmappings, performing the generating.
 3. The method of claim 2, wherein:the flow mappings include (source address (S), multicast group address(G)) (S, G) identifiers of the multicast flows that are mapped to thefixed accounting values, and the multicast packet includes an (S, G)identifier of the multicast flow; and the determining includes matchingthe (S, G) identifier of the multicast packet to the (S, G) identifiersof the flow mappings.
 4. The method of claim 2, further comprising, atthe router: when the multicast packet does not belong to any of themulticast flows in the flow mappings, not performing the generating andthe encapsulating; and encapsulating the multicast packet with aconventional BIER header having an entropy field that only includes asecond variable entropy value for the ECMP load balancing.
 5. The methodof claim 1, wherein the accounting flag is further configured to triggerthe next hop BIER routers to perform reporting their identifiers.
 6. Themethod of claim 1, wherein each of the multicast flows is mapped to adistinct fixed accounting value among the fixed accounting values in theflow mappings.
 7. The method of claim 1, wherein the multicast flows aredivided into distinct sets associated with distinct virtual privatenetworks (VPNs) and each of the distinct sets is mapped to a distinctfixed accounting value among the fixed accounting values of the flowmappings.
 8. The method of claim 1, wherein: the generating furtherincludes encoding the reserved field of the BIER header with an egresstimestamp corresponding to when the forwarding occurs.
 9. The method ofclaim 8, wherein: the generating further includes encoding the reservedfield with a timing flag to indicate that the reserved field includesthe egress timestamp.
 10. The method of claim 1, wherein the fixedaccounting values include one or more virtual private network (VPN)identifiers.
 11. The method of claim 1, wherein the router is an ingressrouter of the network.
 12. The method of claim 1, further comprising, ata second router in the network: receiving the BIER packet forwarded bythe router; parsing the BIER header to retrieve the fixed accountingvalue; and sending, to a controller of the network, a message includingan identifier of the second router and the fixed accounting value. 13.An apparatus comprising: multiple network input/output interfaces; and aprocessor of a router configured to perform Bit Index ExplicitReplication (BIER) forwarding of multicast packets in a network, theprocessor coupled to the multiple network input/output interfaces andconfigured to perform: upon receiving a multicast packet of a multicastflow, accessing flow mappings in which multicast flows are mapped tofixed accounting values corresponding to the multicast flows; generatinga BIER header for the multicast packet by encoding a multi-segmententropy field of the BIER header with (i) a first segment that includesa variable entropy value for equal-cost multi-path (ECMP) loadbalancing, and (ii) a second segment that includes a fixed accountingvalue among the fixed accounting values that is mapped to the multicastflow in the flow mappings; encoding a reserved field of the BIER headerwith an accounting flag configured to indicate that the multi-segmententropy field includes the fixed accounting value, and to trigger nexthop BIER routers to perform flow accounting for the multicast flow andreporting accounting results along with the fixed accounting value;encapsulating the multicast packet with the BIER header to produce aBIER packet; and forwarding the BIER packet.
 14. The apparatus of claim13, wherein the processor is further configured to perform: determiningwhether the multicast packet belongs to any of the multicast flows inthe flow mappings; and when the multicast packet belongs to themulticast flow in the flow mappings, performing the generating.
 15. Theapparatus of claim 13, wherein the accounting flag is further configuredto trigger the next hop BIER routers to perform reporting theiridentifiers.
 16. The apparatus of claim 13, wherein: the generatingfurther includes encoding the reserved field of the BIER header with anegress timestamp corresponding to when the forwarding occurs.
 17. Theapparatus of claim 16, wherein: the generating further includes encodingthe reserved field with a timing flag to indicate that the reservedfield includes the egress timestamp.
 18. A non-transitory computerreadable medium encoded with instructions that, when executed by aprocessor of a router configured to perform Bit Index ExplicitReplication (BIER) forwarding of multicast packets in a network, causethe processor to perform: upon receiving a multicast packet of amulticast flow, accessing flow mappings in which multicast flows aremapped to fixed accounting values corresponding to the multicast flows;generating a BIER header for the multicast packet by encoding amulti-segment entropy field of the BIER header with (i) a first segmentthat includes a variable entropy value for equal-cost multi-path (ECMP)load balancing, and (ii) a second segment that includes a fixedaccounting value among the fixed accounting values that is mapped to themulticast flow in the flow mappings; encoding a reserved field of theBIER header with an accounting flag configured to indicate that themulti-segment entropy field includes the fixed accounting value, and totrigger next hop BIER routers to perform flow accounting for themulticast flow and reporting accounting results along with the fixedaccounting value; encapsulating the multicast packet with the BIERheader to produce a BIER packet; and forwarding the BIER packet.
 19. Thenon-transitory computer readable medium of claim 18, wherein theaccounting flag is further configured to trigger the next hop BIERrouters to perform reporting their identifiers.
 20. The non-transitorycomputer readable medium of claim 18, wherein the instructions to causethe processor to perform the generating include instructions to causethe processor to perform encoding the reserved field of the BIER headerwith an egress timestamp corresponding to when the forwarding occurs.